Method and apparatus for accessing electronic data via a familiar printed medium

ABSTRACT

The disclosed methods and apparatus relate generally to the electronics media industry, such as cable television (CATV), home shopping services, on-line computer services and computer memory applications. These methods and apparatus allow a user to access and make use of electronic media input and output devices by reference to and/or utilization of standard printed matter, such as magazines, textbooks, or any other printed matter that can be correlated to electronic media.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of application Ser. No.09/769,136, filed Jan. 25, 2001 now U.S. Pat. No. 6,843,419, which is acontinuation of application Ser. No. 09/365,961, filed Aug. 2, 1999 nowU.S. Pat. No. 6,866,196, which is a continuation-in-part of applicationSer. No. 08/628,246, filed Apr. 4, 1996, now U.S. Pat. No. 5,932,863,which is a division of application Ser. No. 08/250,799, filed May 25,1994, now abandoned.

FIELD OF THE INVENTION

The present invention relates generally to the Electronic mediaindustry—such as cable television (CATV), home shopping services,on-line computer services, personal computer applications, andCD-ROM-based multi-media applications—and, more particularly, to amethod and apparatus for allowing a user to access and make use of suchelectronic media services via a device that makes use of a standardbook, magazine or other printed work.

BACKGROUND OF THE INVENTION

It is a well-known fact that a large fraction of the population isunfamiliar with the operation or use of modern computer devices. Thisremains true despite significant advances in user-interfacetechnology—such as mouses, windows, menus and the like. It is commonlysaid that such technology makes computers “user friendly.” However, themodern mouse/window/menu-based user-interface technology has been widelyavailable for several years, and yet it still appears that thistechnology is not a panacea for computer-phobia. Indeed, studies haveshown that a majority of VCR owners cannot operate the simple menu-basedinterface used to program their VCRs. Thus, there exists a great needfor improved user-interface technology, if computer-based electronicmedia is to become as widely used and accepted as television or radio.

This need for improved user-interface technology will become evengreater with the arrival of technology such as the presently planned“information superhighway,” which will permit delivery of high-bandwidth(i.e., full-motion video rate) digital data into millions of homes viafiber optic, cable, RF, microwave or satellite links. Such technologywill, in concept, permit instant delivery of a virtually limitlessselection of commercial, informational, educational and entertainmentprogramming at a user's request. However, without better user-interfacetechnology, the average user may not be capable of enjoying the vastcapabilities of such a system. Indeed, it is clear that the number ofprogramming choices available to the user of such technology will be fargreater than the number of choices involved in programming a VCR—a taskalready demonstrated to be too complicated for the average user ofpresent-day user-interface technology. In contrast to the difficultymany people encounter in using remote controls and other prior artcomputer interfaces, printed matter—such as books andmagazines—represents an almost universally familiar and non-intimidatingmedium by which a user can acquire desired information. Even illiterateindividuals incapable of reading text can nonetheless peruse pages ofprinted matter and appreciate the substance of flashy advertisements andthe like. Thus, it would be highly desirable to provide a system withthe information accessing capabilities of a modern CD-ROM or on-linecomputer system, and the user-interface simplicity of printed matter.

The prior art includes a class of devices known as “talking books”—see,e.g., U.S. Pat. No. 4,636,881 entitled TALKING BOOK WITH AN INFRAREDDETECTOR USED TO DETECT PAGE TURNING, U.S. Pat. No. 4,702,573 entitledVISUAL AND AUDIBLE ACTIVATED WORK AND METHOD OF FORMING SAME, U.S. Pat.No. 4,778,391 entitled SOUND-PRODUCING AMUSEMENT OR EDUCATIONAL DEVICES,U.S. Pat. No. 4,809,246 entitled SOUND ILLUSTRATED BOOK HAVING PAGEINDICATOR CIRCUIT, U.S. Pat. No. 4,990,092 entitled TALKING BOOK andU.S. Pat. No. 5,209,665 entitled INTERACTIVE AUDIO VISUAL WORK, all ofwhich are incorporated herein by reference. Typically, these “talkingbooks” consist of a book with various sensors which—when activated bytouching, page turning, etc.—cause a sound generating means (alsoembedded within the book) to produce or replay particular sounds.Talking books thus provide an interface for allowing an unsophisticateduser (i.e., a child) to access a very primitive computer (i.e., thesound generating means embedded within the book) via familiar printedmatter (i.e., the book with embedded sensors). Importantly, however,talking books do not provide a means for interfacing with modernelectronic media—such as cable television (CATV), home shoppingservices, on-line computer services, CD-ROM-based multi-mediaapplications, interactive TV or home computer applications.

One approach to interfacing with these modern electronic media is the“simulated book”—see, e.g., U.S. Pat. No. 4,855,725, entitledMICROPROCESSOR BASED SIMULATED BOOK, incorporated herein by reference.The “simulated book” is in essence a book-size intelligent graphicsterminal. Unlike the talking books, the simulated book is not aself-contained system, but rather transmits commands to and receivesdata from a CD-ROM equipped personal computer via a wireless link. Thus,the programming that the simulated book can access is not limited tothat which can be stored in embedded memory devices, as with the talkingbooks. Importantly, however, the user-interface provided by thesimulated book is essentially the conventional computer interface—i.e.,keys, pointer, menus, etc. Therefore, a computer-phobic user will likelystill find the simulated book intimidating and inaccessible.

A disadvantage of both the talking book and simulated book technologiesis that both include relatively costly electronics—i.e.,microprocessors, memory, display devices, etc.—as a part of the “book.”Thus, these technologies cannot be effectively used to create a“throw-away” interactive magazine, newspaper or advertising brochure.

Thus, there remains a need for a method and apparatus for accessing thevast resources of electronic media using a device as familiar andnon-intimidating as printed matter. There remains a further need forsuch a method and apparatus which utilizes a low cost, throw-awayprinted matter.

SUMMARY OF THE INVENTION

One object of the present invention is a method and apparatus forallowing a user to access electronic media via a printed matter.

Another object of the invention is a method and apparatus for allowing auser to access electronic media relating to, or expanding upon, materialpresented in the printed matter.

Another object of the invention is a low cost, throw-away printed matteruseful in connection with other objects of the invention.

Still another object of the invention is an improved method of providingelectronic media services.

Yet another object of the invention is an intelligent controller for usein connection with the invention.

In accordance with one embodiment, the invention comprises: (i) aprinted matter having at least one sensor and a transmitter associatedtherewith; and (ii) an intelligent controller having a receiver and ameans for accessing programming material. A user triggers said sensorthrough interaction with said printed matter, for example, by touching aparticular spot on a page or by turning a page. In response to thetriggering of said sensor, the transmitter sends a signal indicative ofsaid sensor. The receiver receives said signal and, in response thereto,the intelligent controller executes a pre-programmed command related toaccessing or controlling electronic media or programming. For example,when the user triggers a sensor associated with an advertisement in theprinted matter, the intelligent controller may, in response, send asignal via a telephone line, cable connection, or wireless modem orcellular link to a remote video server, and thereby cause a promotionalprogram to appear on the user's television.

In accordance with another embodiment, the invention comprises: (i) aprinted matter having at least one machine-recognizable feature—such asa bar code or magnetic strip (or any commonly used printed indicia, suchas a printed character, symbol or pictorial icon), (ii) a featurerecognition unit having a means for recognizing said feature and atransmitter, and (iii) an intelligent controller having a receiver. Theuser directs the feature recognition unit to a feature on said printedmatter. In response, said recognition unit transmits a signal indicativeof the identity of the particular feature. The receiver receives saidsignal and the intelligent controller, in response thereto, executes anappropriate pre-programmed command.

In accordance with another embodiment, the invention comprises: (i) aprinted matter having at least one machine-recognizable feature and (ii)an intelligent feature recognition unit having means for recognizingsaid feature, means for associating said recognized feature with acommand, and means for issuing said command over a wireless link. Inuse, the user directs said intelligent feature recognition unit at afeature on said printed matter. In response, said intelligentrecognition unit associates said feature with a pre-programmed commandand issues a pre-programmed command sequence over a wireless data linkto control or access electronic media services. The command may, forexample, be transmitted—via an infrared (IR) or ultrasound link—to aCATV control box in the same groom, or—via a cellular or satellitelink—to the CATV company office.

In accordance with another embodiment, the invention comprises a printedmatter having: (i) at least one sensor, (ii) a control module and (iii)a transmitter associated therewith. In response to the triggering ofsaid sensor, said control module directs the transmitter to transmit acommand related to accessing or controlling an electronic media service.

Other aspects of the invention relate to methods of providing, accessingor utilizing electronic media services. In accordance with one suchaspect, the invention involves: (i) providing a printed matter having atleast one sensor associated therewith, (ii) providing an intelligentcontroller which, in response to the triggering of said sensor, performsa pre-programmed command, and (iii) executing said pre-programmedcommand to access or control an electronic media.

Another aspect of the invention involves a method of providingelectronic media services, which includes the steps of: (i) providingprinted matter to a potential customer and (ii) pre-programming anintelligent controller to access or control an electronic media servicein response to an event wherein the customer interacts with the printedmatter in a particular manner. Advantageously, said printed mattercomprises a low cost, throw-away publication.

In accordance with another aspect of the invention, an improved methodof providing shop-at-home services includes the steps of: (i) providingto the customer a printed catalogue having at least one sensor ormachine-recognizable feature associated therewith, (ii) programming acontroller to execute a pre-programmed command in response to an eventwherein the customer interacts with said sensor or feature, and (iii)providing a service—e.g., displaying promotional programming on thecustomer's television, contacting the customer by telephone,establishing a computer “chat” link, etc.—by telephone, cable, orwireless link in response to the execution of said command.

Another aspect of the present invention relates to an improved method ofinstruction, including the steps of: (i) providing an instructionalprinted matter—such as a textbook, cookbook, children's book ormanual—having at least one sensor or machine-recognizable featureassociated therewith, (ii) providing a means, distinct from saidtextbook or other printed matter, for executing a pre-programmed commandin response to an event wherein a reader interacts with said sensor orfeature, and (iii) in response to said command, causing or controlling:(a) the electronic delivery or presentation of information related tothat in the textbook or other printed matter; and/or (b) theestablishment of a communication link to a live tutor or consultantfamiliar with the subject matter contained in the instructional printedmatter.

Another aspect of the invention relates to a low cost, throw-awayprinted matter—including at least one machine-recognizablefeature—adapted for use in connection with the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The above—as well as other—aspects, objects and features of the presentinvention will be described in the Detailed Description below, which isintended to be read in conjunction with the following set of drawings,in which:

FIG. 1 depicts an embodiment wherein the display unit is embedded withinthe printed matter;

FIG. 2 depicts an embodiment of the invention wherein electronic mediais presented on a user's TV set;

FIG. 3 depicts an embodiment of the invention wherein programmingmaterial is accessed from a remote source;

FIG. 4 depicts an embodiment of the invention which includes a featurerecognition unit;

FIG. 4 a depicts an embodiment of the invention wherein the featurerecognition unit provides an interface between the display unit and aremote source of programming material;

FIG. 5 depicts an embodiment of the invention adapted for presentationof musical programming;

FIG. 5 a depicts an alternative embodiment of the invention adapted forpresentation of musical programming;

FIG. 6 depicts an embodiment of the invention wherein the display unitcomprises a personal computer;

FIG. 6 a depicts an embodiment of the invention wherein the user employsa hand-held scanner/pointer device to select features associated with aprinted matter and to interface with an intelligent controller orpersonal computer;

FIG. 6 b depicts an alternative embodiment of the invention wherein theuser employs a separately attached trackball mouse and hand-held scannerdevice to select features associated with a printed matter and tointerface with an intelligent controller or personal computer;

FIG. 6 c depicts another embodiment of the invention wherein the useremploys a separately attached trackball mouse and digital camera deviceto select features associated with a printed matter and to interfacewith an intelligent controller or personal computer;

FIG. 6 d depicts another embodiment of the invention wherein the useremploys a microphone set up to interface with an intelligent controlleror personal computer which contains voice recognition software to selectfeatures associated with a printed matter;

FIG. 6 e depicts yet another embodiment of the invention wherein theuser employs a traditional keyboard set up to interface with anintelligent controller or personal computer for manual entry to selectfeatures associated with a printed matter;

FIG. 6 f depicts another embodiment of the present invention in which ascanable magnetic strip is set up to interface with an intelligentcontroller or personal computer equipped with a magnetic card reader toselect features associated with a printed matter; and

FIG. 7 depicts an embodiment of the invention adapted for shop-at-homeapplications.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In this section, the various preferred embodiments of the invention aredescribed from two general perspectives. The first, a “functional”perspective, focuses on the contemplated interactions between the userand the various components—i.e., the printed matter, controller, displayunit, etc.—of the invention. This functional description provides theinsight needed to implement the software or firmware used in connectionwith the invention. The second perspective, the “apparatus” view,describes the various technologies that can be used to implement theindividual components of the present invention.

The Functional Perspective

Reference is now made to FIG. 1, which depicts an embodiment of theinvention comprising a printed matter 1 in communication (preferablywireless) with a data server 2. Printed matter 1 includes at least onesensor 3 and a controller, which preferably includes a microprocessor 4.A stiff or flexible page 5 (any page within a book) holds a displayscreen 6.

Printed matter 1 can take the form of a book, magazine, manual, musicalscore, catalog, advertisement, newspaper, telephone or electronicservice directory, or other like means. The controller—includingmicroprocessor 4—is preferably embedded within the spine or any otherpage of printed matter 1.

Display screen 6 can be an LED display, a passive or active matrix LCDdisplay or other like means, and may also have an audio transducerassociated therewith.

Sensor 3 is preferably touch sensitive, but can also be a page sensor ora combination of touch and page sensor, as described below. In responseto a user's touch, microprocessor 4 causes programming material to beretrieved from data server 2 and displayed on screen 6. Datacommunication between server 2 and microprocessor 4 may operate via RFcellular, microwave, IR, optical, conductive, telephonic or CATV links,or any combination of these or other like means.

Reference is now made to FIG. 2, which depicts an alternative embodimentof the invention comprising a printed matter 21, an intelligentcontroller 24 and display unit 25. Printed matter 21 includes at leastone sensor 22 and a transmitter 23. In response to a user's actuation ofsensor 22, transmitter 23 transmits a coded signal indicative of theidentity of the actuated sensor. A receiver 26 in intelligent controller24 receives the coded signal. Controller 24 then identifies the actuatedsensor, and initiates display of appropriate programming material ondisplay unit 25 (which can be a. TV set or any other means for audio oraudiovisual presentation, including but not limited to a personalcomputer). Programming material preferably derives from a mass storagedevice—e.g., a magnetic disk, CD-ROM, ROM, flash RAM, PCMCIA card orother memory means—associated with intelligent controller 24 (or withdisplay unit 25). As used herein, the term “memory means” shall alsoinclude future storage technologies, such as the recently announcedmulti-layer CD-ROMs being developed by IBM. See “New I.B.M. Laser MethodStacks Data on Disks,” New York Times, May 13, 1994.

Reference is now made to FIG. 3, which depicts an embodiment of theinvention in which intelligent controller 31 derives programmingmaterial from a remote server 30. Controller 31 includes means foraccessing a remote server 30 of programming material, and preferablyfurther includes means for decompressing compressed programming materialreceived from server 30. In response to a coded signal received byreceiver 26, intelligent controller 31 sends an appropriate command toserver 30 to select and initiate transfer of appropriate programmingmaterial. Controller 31 then receives programming material from remoteserver 30 and prepares (e.g., decompresses, if necessary) the materialfor presentation on display unit 25. As with conventional pay-per-viewCATV services and on-line computer services, the user is billedaccording to the volume and/or nature of programming material requested.

Reference is now made to FIG. 4, which depicts an embodiment of theinvention including a printed matter 40, a feature recognition unit 42,an intelligent controller 31, a server 30 and a display unit 25. Printedmatter 40 includes at least one machine-recognizable feature 41 in theprinted work, such as a bar code, invisible bar code, magnetic code,printed character, symbol or pictorial icon, or other feature.

Feature recognition unit 42 is a hand-held device and includes means 44for recognizing feature 41, a transmitter 45 and an optional useractuation switch 43. The user directs recognition unit 42 at a featureand depresses actuation switch 43. In response thereto, means 44 forrecognizing “reads” (i.e., for a printed feature, scans and identifies)the feature 41, and transmitter 45 transmits a coded signal indicativeof the identity of feature 41. The operation of controller 31, server 30and display unit 25 is otherwise identical or similar to the FIG. 3embodiment.

Still referring to FIG. 4, use of embedded features 41—as opposed tosensors—lowers the fabrication cost of printed matter 40.Advantageously, printed matter 40 can be a low cost, throw-awaypublication.

An identification code generated either by recognition unit 42 orintelligent controller 31 allows the user to be billed for his/her useof transmitted material by server 30 and, for commercial applications,allows the advertiser to identify the potential customer.

Reference is now made to FIG. 4 a, which depicts an embodiment of theinvention in which the functions of the intelligent controller areintegrated into a recognition/control unit 46. Unit 46 includes means 44for recognizing feature 41 and means 48 for accessing—preferably via acellular RF link—programming material associated with server 30. Inaddition, recognition/control unit 46 optionally includes amicroprocessor. Either recognition/control unit 46 or display unit 47may include means for decompressing compressed programming material.

Reference is now made to FIG. 5, which depicts an embodiment of theinvention adapted for musical applications. The embodiment includes aprinted musical score 50, an electronic baton 51, a music controller 55and an audio/audiovisual player 56. Using baton 51, the user directs arecognition means 52—which can be either a CCD camera or a magneticdetector—at a particular portion 57 of printed score 50. Transmitter 53then transmits a coded signal indicative of the selected portion 57.Music controller 55, in response to the coded signal, directs thepresentation of appropriate audio or audiovisual programming on player56. Music controller 55 may include a means for storing programmingmaterial—such as ROM, CD-ROM, flash RAM, PCMCIA card or other memorymeans—or an electronic musical synthesizer, or both.

Reference is now made to FIG. 5 a, which depicts an alternativeembodiment of the invention directed to musical applications. In FIG. 5a, music controller 55 a retrieves programming material from a remotedata server 57. Using a remote server permits continuous updating ofprogramming material, such as replacing one performance or opera companywith another. Either player 56 or controller 55 a preferably includesmeans for decompressing compressed programming material received fromserver 57.

Reference is now made to FIG. 6, which depicts an embodiment of theinvention utilizing a personal computer to access and display electronicprogramming material. In this embodiment, portions of the personalcomputer provide the functions of the previously-described intelligentcontroller, while other portions of the computer provide the functionsof the display unit. The scope of this invention should not be limitedto the traditional notions of Personal Computers. The present inventionwill find use in conjunction with more non-traditional applications suchas WEB-TV®, Video Phones, as well as other chip based technologies. Aninterface unit 60 includes a receiver 26 for receiving a coded signalfrom a transmitter 23, representative of an actuated sensor 22 (or, inan alternative embodiment which includes a feature recognition unit,from the feature recognition unit indicative of the selected feature) onprinted matter 21. Interface unit 60 connects to personal computer 61 byany conventional means, such as an I/O port, card slot, etc. Personalcomputer 61 monitors the interface unit 60, and displays (or controlsthe display of) appropriate programming material selected by the userthrough his/her interaction with printed matter 21.

Programming material can be stored on personal computer 61—on a ROM,CD-ROM, flash RAM, PCMCIA card, or other disk/card supplied along withprinted matter 21—or accessed from a remote data server 62.

Reference is now made to FIG. 6 a, which shows an embodiment of theinvention wherein a user employs a hand-held recognition device 67 to:(i) select programming material associated with a feature 41 on aprinted matter 40; and (ii) control or interact with a personal computer65 during the presentation and/or execution of the programming material.The recognition device 67 may be comprised of one of many possibledevices already in use within the computer and electronics industry.

The prefered embodiment may utilize a scanner/mouse which is describedin detail in U.S. Pat. No. 4,804,949, entitled HAND-HAND-HELD OPTICALSCANNER AND COMPUTER MOUSE, which is incorporated herein by reference.The FIG. 6 a embodiment provides at least two modes of interaction forthe use of the Scanner/Mouse:

-   -   (i) Scan Mode:        -   In this mode, scanner/mouse 67 operates as a scanner. The            user points scanner/mouse 67 at a feature 41 in a printed            matter 40 and depresses a switch to cause the feature to be            scanned. Personal computer 65 receives the scanned image,            decodes it, and executes a pre-programmed command in            response. Execution of the pre-programmed command may, for            example, cause personal computer 65 to fetch an interactive            software program from a centralized data bank 62, and begin            execution of the fetched software. Once the fetched software            begins executing, scanner/mouse 67 may be placed into            mouse/trackball mode, in order to support interaction            between the user and personal computer 65.    -   (ii) Mouse/Trackball Mode:        -   In this mode, scanner/mouse 67 operates as a normal X-Y            movement sensor, such as a mouse or trackball. Thus, this            mode is useful to control conventional graphical interface            functions, such as menus, windows, icons, cursors, video            games, etc. Those skilled in the art will appreciate that            this mode can provide any or all features typically found in            modern graphical user interfaces.

The scanning function of the mouse may in the alternative beaccomplished by the utilization of a bar code or other symbol laserscanning device incorporated within the hand-held unit 67. Thisinvention is commonly used in grocery stores, and automated warehousingapplications to price, and inventory goods. These scanners may bemanufactured as a single unit with the trackball mouse of the PC 65 oralternatively may be employed as a separate device 69 with separatelyattached trackball mouse 64 as shown in FIG. 6 b. As described ingreater detail in U.S. Pat. No. 4,387,297, entitled PORTABLE LASERSCANNING SYSTEM AND SCANNING METHODS, these laser scanning devices 69have a trigger within the device which initiates a repetitive scanningof each object bearing a symbol 41, and an indicator displays when thereading of that particular object has been completed. The recognition ofthe symbol 41 is accomplished by the generation of a miniature lightbeam from the unit which is reflected in varying intensity depending onthe qualities of the symbol 41. A sensing means within the unit detectsthe intensity of the light reflected from the symbol 41. The detectingmeans then generates an electrical signal indicative of the detectedintensity of the light. A signal processing means then interprets theelectrical signals to generate data descriptive of the symbol. Theprinted matter 40 would be affixed with bar codes or other symbols 41which could be read with the laser scanning device 69. The user would bedirected to place the scanning portion of the device upon the symbol 41and depress the trigger at appropriate times while reading or viewingthe printed matter 40. The symbol 41 once scanned and processed woulddeliver a corresponding digital command, or reference to the software ofthe PC 65 working in coordination with the scanning device 69.

An additional peripheral device which may be employed to recognizesymbols could be the digital camera 63 shown in FIG. 6 c. The digitalcamera 63 has gained popularity over recent years, and would have theadvantage in this application of already being available to consumerswho have either purchased it for its picture quality digital images, orfor those who would be interested in the cameras multi-functional useincluding this application. The digital camera 63 employs solid statesensing devices such as a charged coupled device to record images. Theoptical images which are recorded are then converted to discreetelectric signals, which are then stored in various memory devices. Theimages may then be recalled from the memory device to be displayed,printed, or otherwise manipulated. One of the applications of thedigital camera 63 is in the downloading of digital images to personalcomputers 65. The digital camera 63 could therefore be used to downloadimages of symbols 41 within reading materials 40 to the user's PC 65.Symbol processing software on the PC 65 could then interpret symbolsdownloaded from the digital camera 63 or its memory, and the PC 65program's code logic would thereby trigger corresponding functions of PC65.

The triggering of the functions of PC 65 could also be initialized byverbal commands 58 a from the user 58, as shown in FIG. 6 d. The PC 65could be affixed with a microphone 59. As the user 58 reads or workswith a printed material 40 she could be instructed to pronounce verbalcommands 58 a into the microphone 59 by feature 41 in the printed matter40. The PC 65 would then have voice recognition software which wouldinterpret the verbal commands 58 a from the printed matter 40 to accessthe programing material by, for example running applications whichcorrespond with the commands.

In yet another alternative embodiment of the invention the feature 41 ofprinted matter 40 could also be manually entered into the PC 65 by wayof a traditional keyboard 68 shown in FIG. 6 e. Users of the printedmatter 40 who, for example, are reading advertisements, or workingthrough a tutorial would be directed to manually input codes or wordcommands (feature 41) into the PC 65 by way of a keyboard 68. Thecommand would then, similar to other sensing devices, initialize aprogram or PC function which would operate in concert with the printedmatter 40.

In each of the configurations of this invention described in FIGS. 6 a-6f, PC applications may be retrieved from PC interfaces 62 such as CD ROMdrives, hard drives, PCMCIA cards, Flash RAM, web interfaces, or anyother addressable memory device which the PC has access too.

The coded information might also be transferred to the computer througha scanable magnetic strip 41 a as shown in FIG. 6 f. Known magneticstrip technology, used such as that credit and debit cards, hasinformation as fixed electronic data embedded on the surface of thecard. The PC 65 will have a magnetic card reader 49 connected to one ofits external ports. The printed matter 40 will direct the user to readthe magnetic strip 41 a into the reader 49. The information embedded onthe magnetic strip will provide commands to the PC 65 to accessprograming material by directing currently running applications, or toretrieve and run applications from remote or local sources.

Data collected from the sensing device(s) in the form of digital imagesor translated to a decoded command may by transferred to the PC 65 via aMETHOD AND SYSTEM OF BI-DIRECTIONAL PARALLEL PORT DATA TRANSFER BETWEENDATA PROCESSING SYSTEMS as described in detail in U.S. Pat. No.5,600,793. This process transfers discreet packets of data both to andfrom peripheral devices. These devices would be in constantcommunication, allowing both the sensing device as well as the PC 65 tosend and receive data. Alternatively the data may be transferred viainfra red, microwave or some other light frequency data transfer method.The user might also desire that the sensing device be manufactured inkind with the traditional television remote control device. This wouldre-enforce the desirability of the unit being manufactured in a wirelessunit with a light emitting data transfer method as described above. Thisadvantage would of course be balanced with the cost effectiveness of thedesign, as well as the reliability of the data transfer via eithermethod.

Reference is now made to FIG. 7, which depicts an embodiment of theinvention adapted for commercial and shop-at-home applications. Thecustomer views and interacts with a printed matter 70 (via sensors or afeature recognition units, both as previously described). Printed matter70 is preferably a throw-away catalog or advertising brochure listingcommercial items, such as programming choices, merchandise, travel orevent schedules, or television and/or radio programming schedules. Theuser interacts with printed matter 70 (i.e., with certain featuresand/or sensors therein) to cause a coded signal 71 indicative of thecustomer's selection to be transmitted (either by a transmitter embeddedin the printed matter or within a feature recognition unit) tocontroller 73. In response thereto, controller 73 utilizes amodem/telephone (or other wired or wireless communication) link 74-75 tocommunicate the customer's selection to a commercial provider's remoteoffice 78 (or to a centralized data bank or information superhighway).

The commercial provider preferably uses a “caller ID” function toidentify the customer and can respond in a number of ways: (i) have arepresentative contact the customer; (ii) send the ordered merchandiseor tickets to the customer; (iii) direct a data server 72 to provideprogramming or additional promotional material via a CATV line 76 tocontroller 73, which replays the material on the customer's TV set; or(iv) download and execute an interactive merchandise selection programon the customer's personal computer or any other electronic media input,output or sensory stimulating device.

The Apparatus Perspective:

The various technologies used to implement the individual functionalcomponents that comprise a part of this invention are described below.

Touch Pad Technology

Sensor 3 can be implemented using a wide variety of presently availabletouch sensitive pad technology. See, for example, U.S. Pat. No.5,016,008 entitled DEVICE FOR DETECTING THE POSITION OF A CONTROL MEMBERON A TOUCH-SENSITIVE PAD, U.S. Pat. No. 5,012,124 entitled TOUCHSENSITIVE CONTROL PANEL, U.S. Pat. No. 4,862,151 entitled REMOTE CONTROLDEVICE FOR A COMPUTER ASSOCIATED WITH A VIDEO SCREEN, U.S. Pat. No.4,827,084 entitled SOLID STATE IMAGE DETECTOR AND SIGNAL GENERATOR andU.S. Pat. No. 4,644,101 entitled PRESSURE-RESPONSIVE POSITION SENSOR,all of which are incorporated herein by reference.

Referring now to FIG. 2, a plurality of touch sensors 22 are embeddedwithin the back binding of the printed matter 21. Alternatively, touchsensors 22 can be positioned along inner or outer margins of thebinding, or of particular pages, of printed matter 21 (or along an edgeof a mounting tray in which a disposable printed matter is placed).Electronics mounted within printed matter 21 (or within a mounting tray)responds to the actuation of a touch sensor 22 and transmits a codedsignal indicative of the identity of the actuated sensor.

Advantageously, touch sensors can be combined with page sensors—asdescribed in U.S. Pat. Nos. 5,209,665; 4,990,092; 4,636,881 and4,809,246, all previously incorporated herein—to provide a larger numberof “effective sensors.” In this embodiment, each time a sensor isactuated, the electronics within the printed matter also checks the pagesensor(s) to determine which page is currently being viewed. Theelectronics then generates a coded signal that identifies both thesensor actuated and the currently visible page. Thus, each (page,sensor) combination represents, in essence, a single “effective sensor.”

Hybrid embodiments combining touch pads and page sensors are alsopossible. For example, a printed matter might contain a sheet of touchsensors every so many pages, with the page interval being dependent onthe stiffness of the pages and the responsiveness of the sensors. Thatis, if the maximum number of pages through which a user's touch could bereliably detected by a touch sensor was X, then the printed matter wouldpreferably include a sheet of touch sensors every X pages of text.

Intelligent Controllers and Data/Communication Servers

In accordance with several embodiments of the invention, an intelligentcontroller controls the selection of programming in a video “fileserver” system. File servers are well known in the art. Generally, asused herein, the term intelligent controller can refer to computerequipment having either: (a) some type of mass storage device, typicallya magnetic or magneto-optical disk, that is connected to a network andutilized as central storage for multiple users via the network; and/or(b) some type of network interface which allows establishment of acommunication link with other user(s).

Referring to a “file server” type of intelligent controller, theinformation that is typically stored on such a system consists of binarycomputer data such as executable programs and corresponding data.Exemplary of the types of corresponding data stored are numbers forspreadsheets, ASCII characters and codes for word processors, anddrawing commands for drawing and CAD programs. These or similar types ofdata do not generally have a time element associated with them, nor dothey generally require any extra processing beyond the usualinterpretation that is accomplished by the computer program with whichthey are intended to be used.

In contrast, the playback of audio/video information has a time elementassociated with its use. Furthermore, the amount of data required tostore audio/video program information in “raw” digital form is oftenprohibitive. Thus, it is common to employ audio/video compressiontechniques to compress audio/video program information before it isstored. As a result, further processing in the form of decompression anddigital-to-analog conversion is required before the real-time viewing ofan audio/video program can take place. Decompression may be accomplishedthrough the use of known hardware or software techniques.Digital-to-analog conversion may be required, depending on the type ofequipment used for viewing the audio/video program. A known audio/videofile server apparatus manufactured and marketed by Protocomm of Trevose,Pa. permits real-time playback of compressed audio/video programinformation.

Generally, modern audio/video file server systems include: a storageunit for centrally storing compressed digital audio/video programinformation, a transceiver for receiving compressed digital audio/videoprogram information from an external source over a network (or wirelesscommunication link) to update the stored audio/video programinformation, a plurality of playback units, each associated with anexternal playback line and an external playback station, each includinga decompression unit, for receiving selected compressed digitalaudio/video program information from the storage unit, for decompressingthe selected compressed digital audio/video program information receivedfrom the storage unit, and for playing it in real time over theassociated playback line to the associated playback station, a networkinterface unit for receiving playback requests from the playback units,and a processor for controlling the storage and playback units to playthe decompressed selected audio/video program information in real timefor viewing by users at selected playback stations.

Such a system is described, for example, in U.S. Pat. No. 5,262,875entitled AUDIO/VIDEO FILE SERVER INCLUDING DECOMPRESSION/PLAYBACK MEANS,which is incorporated herein by reference. The '875 system can beadapted to operate in accordance with the present invention by couplingintelligent controller of the present invention with the '875 system'snetwork interface unit (which provides the playback requests to theplayback unit). In the '875 system:

-   -   “Playback may be initiated through a user request from one of        the playback stations or through direct interaction with        audio/video file server 5. In the latter case, a simple user        interface, such as a menu interface, may be employed for        selection of the desired program information and the playback        station. For example, a menu of the available items of        audio/video program information, as named by the user or by the        system, may be presented. The user may make a selection through        cursor control keys on a keyboard.”        In contrast, the present invention permits the user to select        and control the presentation of audio/video programming through        a familiar printed matter interface, as has been previously        described. The present invention thus offers the advantage of        nearly universal accessibility.

In accordance with the present invention, multimedia programming ispreferably delivered from the file server(s) to the replay unit via anIntegrated Service Digital Network (ISDN). U.S. Pat. No. 5,206,859entitled ISDN MULTIMEDIA COMMUNICATIONS SYSTEM, incorporated herein byreference, describes such a system.

In accordance with the invention, a variety of means can be employed tocommunicate selection instructions to the video server and tocommunicate programming material from the server to the user's displayunit. Since the selection instructions are very compact (i.e., lowbandwidth), these instructions can be communicated via a standardtelephone link using an inexpensive, low speed modem. This is similar,for example, to the method cable TV viewers use to select pay-per-viewprogramming from local CATV companies—i.e., the viewer calls aparticular toll-free number associated with the desired program, and theCATV office uses a “caller ID” function to determine which customer isto receive the program.

Communication of the programming material from the server to the displayunit may require a higher-bandwidth means. No doubt, certainmaterial—such as pricing information for a shop-at-home service orscheduling information for a travel booking service.—could be easilytransmitted via an inexpensive telephone/modem link. In addition, usingthe preferred compression/decompression techniques, many multi-mediaapplications could also operate over a conventional telephone link. Highquality audio/video programming, however, will likely require a higherbandwidth transmission medium, such as a CATV line, microwave link, DSBlink, optical fiber link, cellular radio link, or enhanced bandwidthtelephone connection.

Although the invention has been described above with reference toseveral presently preferred embodiments, such embodiments are merelyexemplary and are not intended to define the scope of, or exhaustivelyenumerate the features of, the present invention. Accordingly, the scopeof the invention shall be defined by the following claims. Where afeature or limitation of a preferred embodiment is omitted in a claim,it is the inventors' intent that such claim not be construed toimpliedly require the omitted feature or limitation.

1. A system for displaying programming material to a user, the systemcomprising: a textbook having at least one machine recognizable feature;a feature recognition unit having associated therewith a means forrecognizing said feature and a means for transmitting a coded signal inresponse to the recognition of said feature; an intelligent controllerhaving associated therewith a means for accessing said programmingmaterial in response to receiving said coded signal; and a display unitfor presenting said programming material.
 2. A system according to claim1 wherein said at least one machine recognizable feature has associatedtherewith a data link which is recognized by said feature recognitionunit.
 3. A system according to claim 2 wherein said data link isselected from the group consisting of an image data link, a video datalink, an audio data link, a programming data link, an online data link,a pictorial data link, an electronic data link, and an electronic medialink.
 4. A system according to claim 2 wherein said data link comprisesan “information superhighway” data link.
 5. A system according to claim4 wherein said “information superhighway” data link is selected from thegroup consisting of the Internet, a computer network, a local areanetwork, a wide area network, a wireless network, an Ethernet network, aRadio Frequency cellular network, an Integrated Services DigitalNetwork, a telephone line, and a cable television line.
 6. A systemaccording to claim 1 wherein said at least one machine recognizablefeature is selected from the group consisting of a printed matter, acode, a bar code, a magnetic stripe, an audible audio emitting device, abiometric sample, a watermark, a transmitter, a radio frequencyidentification device tag, an infrared tag, and a quantum dot.
 7. Asystem according to claim 1 wherein said recognition unit is selectedfrom the group consisting of a scanner, a camera, a bar code scanner, acode reader, a magnetic stripe reader, an audio recognition device, abiometric reading device, a watermark reader, a receiver, a radiofrequency identification device reader, an infrared reader, and aquantum dot reader.
 8. A system according to claim 1 wherein saidprogramming material comprises information.
 9. A system according toclaim 8 wherein said information comprises at least one selected fromthe group consisting of said textbook information, a multimediapresentation, an instructional material, a study-guide material, aninteractive exam, an educational course outline, a critical thinkingexercise, a lecture outline, an audiovisual classroom material, aclassroom teaching tip, a publisher information, and an individualinformation identified by a registration document.
 10. A systemaccording to claim 1 wherein said programming material comprises a webpage related to at least one selected from the group consisting of saidtextbook, a professional organization referenced in said textbook, apublisher of said textbook, a government agency reference in saidtextbook, a commercial entity referenced in said textbook, a culturalinstitution, and an information about a educational institution.
 11. Asystem according to claim 1 wherein said programming material comprisesa service.
 12. A system according to claim 11 wherein said serviceincludes at least one selected from a group consisting of displayingpromotional programming on said display unit, conducting an interactionwith said user via a telephone, conducting an interaction with aplurality of users via an on-line communication chat link, andconducting an interaction between a tutor and said user via an on-linecommunication chat link.
 13. A method of providing a user access toprogramming material associated with a textbook, the method comprisingthe steps of: printing a machine recognizable feature within saidtextbook wherein said machine recognizable feature has associatedtherewith a command sequence for accessing programming material;scanning said machine recognizable feature within said textbook anddownloading data indicative of said machine recognizable feature via theInternet to a remote server; accessing programming material from saidremote server; and transmitting said programming material to said userallowing said user to perceive said programming material, wherein saidprogramming material is related to the contents of said textbook. 14.The method of claim 13 wherein said machine recognizable feature isselected from the group consisting of a printed matter, a code, a barcode, a magnetic stripe, an audible audio emitting device, a biometricsample, a watermark, a transmitter, a radio frequency identificationdevice tag, an infrared tag, and a quantum dot.